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Topics 

❖  Current  Status:  Baseline  analysis  of  the 
current  cost  estimating  community,  including 
which  organizations  are  responsible  for 
developing  and  reviewing  cost  estimates,  how 
many  personnel  there  are,  what  their 
longevity  in  the  profession  is,  and  what  their 
current  professional  skillsets  are. 

❖  T  rends 


❖  The  Future 
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PURPOSES  OF  EFFORT  FOR 
•  DEPARTMENTS  OF  ARMY  AND  NAVY 


•  Overarching  purpose  is  to  identify  areas  for 
improvements  in  cost  estimating,  analysis  and 
management  community  to  ensure  high  quality, 
responsive,  and  customer-focused  support  at  all  levels 
in  the  departments. 

Develop  baseline  assessment  of  Army’s  and  Navy’s  cost  estimating,  analysis  and 
management  communities 

Evaluate  the  extent  to  which  the  cost  estimating  and  analysis  community  is  meeting 
Army  and  Navy  leadership’s  current  and  projected  needs 

Evaluate  the  extent  to  which  the  cost  management  community  is  meeting  Army 
leadership’s  current  and  projected  needs 

Support  DASA-CE’s  mission  to  “Provide  the  Army  decision-makers  with  cost, 
performance  and  economic  analysis  in  the  form  of  expertise,  models,  data, 
estimates  and  analyses  at  all  levels  ” 

Support  NCAD’s  mission  to  “guide,  direct,  and  strengthen  cost  analysis  in  the 
DoN” 


Produce  specific  recommendations  for  improvements.' 
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Scope 


o  PEOPLE.  What  is  the  size,  location,  and  experience  of  the 
government  in-house  cost  estimating  and  analysis 
workforce? 

o  PROCESS:  What  analyses  are  done,  at  whose  request,  how 
are  the  results  transmitted,  and  who  else  receives  the 
results?  What  processes  exist  for  the  execution  of  cost 
research,  recruiting,  training,  knowledge  sharing  and  QA, 
including  accountability  for  timeliness  and  reliability? 

o  TECHNOLOGY:  What  data,  estimating  tools,  research  and 
IT  infrastructure  are  available  to  support  the  cost  estimating 
and  analysis  workforce? 


The  study  compares  the  current  status  of  people,  processes,  and 
technologies  to  those  that  are  needed  to  meet  the  challenges  in 
the  21st  century. 
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APPROACH 


study 


Phase  1 


Phase  2 


PROJECT  LAUNCH 
AND  STRUCTURING 


•FINALIZE 

APPROACH 

■DESIGN  SURVEYS 
AND 

QUESTIONNAIRE 

Identify 

Community 

leadership 


BASELINE 

ASSESSMENTS 


This  is  a  multi-phase 


Phase  3 


Phase  4 


CUSTOMER 
REQUIREMENTS 


GAP  A 

ANALYSIS 

RECOMME 

FORC 

iNDATIGNS 

:hange 

TO 


- * - 

IMPLEMENTATION 
AND  REVIEW 


INITIAL 

OBSERVATIONS 

FROM 

DEPARTMENT  OF 
NAVY  EFFORT 


uoiN  ut/a  Locations 


•The  CE/A  community  is  largely  bi-coastal. 

’China  Lake  and  Lakehurst  are  included  in  NAVAIR’s  totals 
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DoN  Cost  Estimating  Personnel  Totals 


TOTAL  PERSONNEL:  348 
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There  are  348  personnel  identified  in  the  baseline  assessment  of  the 
DoN  CE/A  community.  NAVAIR  HQ  has  54%  of  the  total.  NAVSEA 
has  another  15%  of  the  total  personnel,  so  that,  together,  NAVAIR 
and  NAVSEA  have  60%  of  the  total  personnel  in  the  DoN  CE/A 


community. 

19 
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DoN  Cost  Estimating  Personnel  By  Grade  Levels 


BY  GRADE  LEVELS 

176 


BY  GRADE  LEVELS 

- T5%~~ 


•There  are  more  personnel  in  the  GS  12-13  grade  levels  (or  their 
equivalent  levels  in  other  pay-banding  structures)  than  in  all  the 
other  grades  combined. 
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DoN  Cost  Estimating  Personnel  By  Years  of  Experience 


YEARS  OF  EXPERIENCE 


YEARS  OF  EXPERIENCE 


•~50%  of  the  CE/A  workforce  is  “young”,  having  only  1-5  years  of  experience.  Mean 
years  of  experience  is  estimate  at  10  years.  Combining  this  observation  with  the  Grade 
level  information  suggests  that  personnel  reach  a  working  grade  level  of  GS  12-13  fairly 
quickly.  In  the  2003  SCEA  National  Survey  (445  respondents),  the  mean  years  of 
experience  is  18.4  years,  almost  twice  the  DoN  CE/A  community  level. 


•Not  shown  here  is  that  many  of  the  current  DoN  CE/A  leadership  are  graduates  of  the 
DoN  CE/A  Intern  Program 


DoN  Cost  Estimating  Personnel  By  Academic  Achievement 


ACADEMIC  ACHIEVEMENT 


61% 


High  School  BA  or  BS  Graduate 

Degree 


ACADEMIC  ACHIEVEMENT 


4% 


|  ■  High  School  □  BA  or  BS  □  Graduate  Degree 


■ 


Fully  one-third  of  the  DoN  CE/A  community  workforce  has  a  graduate 
degree,  while  a  very  small  5%  of  the  total  workforce  does  not  have  at 
least  a  bachelor’s  degree.  By  comparison,  almost  65%  of  those  who 
responded  to  the  2003  SCEA  National  Survey  have  either  a  master’s 
degree  or  a  doctorate. 


DoN  Cost  Estimating  Personnel  By  Professional  Certifications 


Number  of  personnel  with 

professional  certifications 

175 
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In  professional  certifications,  the  focus  is  fully  on  DAWIA  and  its  levels  of 
certification.  Surprisingly,  only  1%  of  the  total  personnel  hold  the  Certified 
Cost  Estimator/Analyst  (CCE/A)  professional  certification  from  the  Society  of 
Cost  Estimating  and  Analysis  (SCEA).  As  a  point  of  comparison, 
approximately  one-third  of  SCEA’s  membership  personnel  holds  the  CCE/A 


professional  certification. 
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DoN  Cost  Estimating  Personnel  By  Prior  Job  Source 


Personnel  come  to  positions  in  the  DoN  CE/A  community  either 
directly  from  college  or  from  a  position  in  another  government 
agency.  “Out-migration”  (i.e.,  the  flow  of  personnel  from  US 
government  positions  to  non-US  government  positions)  is 
apparently  much  higher  than  “in-migration  (i.e.,  the  flow  of 
personnel  from  a  non-US  government  position  to  a  US 
ttfpent  position). 
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The  following  data 
on  DA  Cost 
Estimating  and 
Analysis 
Community  are 
incomplete. 


DA  Cost  Estimating  Personnel 
_ Totals 


Number  of  CE/A  Respondents  by  Agency 
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DA  Cost  Estimating  Personnel 

By  Grade  Levels 


Number  of  CE/ A  Respondents  by  Grade 


UA  Cost  Estimating  Personnel  By 

Years  of  Experience 


DA  Cost  Estimating  Personnel  By 
•  #  •  Academic  Achievement 


❖  Current  Status 


❖Trends  Circumstances  which  are  causing 
an  explosion  in  Cost  Estimating 
Requirements  across  the  DoD  in  particular, 
but  also  across  the  full  spectrum  of  US 
Government  activities. 


❖The  Future 


The  Federal  Sector  Faces  Major  Challenges 


From  Externa 1  Threats... 
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®  ^  The  Federal  Sector  Faces  Major  Challenges 

...And From  Internal  Inefficiencies 


"Achieving  the  President's  vision  requires  effective 
IT  management  practices.  The  federal 
government  is  spending  $45  billion  on  IT  in  2002, 
and  this  Budget  estimates  an  increase  to  $50 

hillinn  in  7nfR  Ri  it 


•  Poor  IT  Management  Practices 

•  IT  I  nvestments  That  Lack  a  Valid 

Business  Case  Will  Not  Be  Funded  by 
OMB  _ 


"Duplicative  IT  investments." 


“^^^hei^ai^examplesofgoodsecurity  in  many  agencies, and 
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Significant  Deficiencies  in  Security 

Requirement  to  I  corporate  Security  I  nto 
Capital  Plans  and  BCAs 


process, OMB  directed  agencies  to:  I  jrepoPHJeCHfl!^ 


investments;  2)document  in  their  business  cases  that  adequate  security 
controls  have  been  incorporated  into  the  life  cycle  planning  of  each  IT 
investment;  3)reflect  the  agency ’s  security  priorities  as  reported  in  their 
corrective  action  plans;  and  4)tie  their  corrective  action  plans  for  an  IT 
investment  directly  to  the  business  case  for  that  investment. 


"Few  IT  investments  have  significantly  improved 
mission  performance.  (Setting  departmental 
priorities  among  competing  project  proposals  has 
been  exception,  not  the  rule.) " 

"Few  agencies  have  plans  demonstrating 
documenting  the  linkage  between  IT  ca 
and  the  business  needs  of  the  agency.” 

"Many  major  IT  projects  do  not  meet  cc 
schedule,  and  performance  goals.” 

"Major  gaps  exist  in  agency  and  govern 
wide  computer- related  security." 

Source:  Analytical  Pen 


sources:  FY  2001  Report  to  Congress  on  Federal  Government 

rm,  0MB\ 


Government  I  s  Missing  the 
Competition.  ^formation  Required  to 
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Why  Credible  Cost  Estimates  are  Important 


Underestimates  lead  to  implementation  coasters 
•  Insufficient  resources 
Panicked  decisions 


Unrealistic  expectation^Tnereased 

•  Imprudent  economics^  Risk 
Overestimates  lead  to  plaoruna  and^i/ds^t  di: 

Underutilized  resources 

•  Excess  capacity 
Wasteful,  un-competitive  pricing 


Provide  senior 
decision  makers  an 
understanding  of 
options  and 
constraints 

^4-  Prevent  making 
breaking^ 
proarams 


At  the  Service,  OMB  and  Congressional  levels,  loss  of  credib 
program  and  financial  flexibility,  such  as  as  Congress’  legisla 
caps  and/or  schedules  in  attempts  to  avoid  future  cost  growth. 


Ijty  results  in  loss  of 
ting  de  facto  cost 


DoD  Has  a  Solution  for  Large  Programs: 


Statutory  and  Regulatory  Bases  for  DoD  Cost  Estimates 

use  Title  10,  Section  2432: 


The  SecDef  shall  report  a  full  life  cycle  cost  for  each  major  defense  acquisition  program  (MDAP) 


The  SecDef  may  not  approve  SDD,  or  the  production  and  deployment,  of  a  MDAP  unless  an  independent 
estimate  of  the  full  life-cycle  of  the  program  ...  [has]  been  considered  by  the  Secretary. 

...  the  independent  estimate  ...  [shall]  --  (a)  be  prepared  by  an  office  or  other  entity  that  is  not  under  ...  the 
military  department ...  directly  responsible  for  ...  [developing  or  acquiring]  the  program;  and  (b)  include  all  costs  .... 
without  regard  to  funding  source  or  management  control  ... 


DoDI  5000.2: 


. .  .the  CAIG  shall  prepare  an  independent  life-cycle  cost  estimate  and  report  for  all  milestone  reviews  after 
Milestone  A  (Program  Initiation/Milestone  B  &  C). 

DoD  Directive  5000.4: 

. . .  the  OSD  CAIG  is  chaired  by  the  Deputy  Director,  Resource  Analysis,  in  the  Office  of  the  Director, 
Program  Analysis  &  Evaluation 

SECNAV  INSTRUCTION  5420 .  Within  the  DON,  the  Naval  Cost  Analysis  Division  (NCAD),  of  the  ASN(FM&C)),  Office 
of  Budget  (FMB),  is  the  designated  component  cost  analysis  group. 


DoD  Has  a  Solution  for  Large  Programs 

The  Formal  Acquisition  Process 


DOD  5000  ACQUISITION  PROGRAM 

WHAT 

LCCE,  includes  all  life  cycle  phases:  RDT&E;  Procurement; 
Operations  and  maintenance,  and  disposal 

WHY  (Statutory  and  policy  imperatives) 

USC  Title  10,  Section  2432:  The  SecDef  shall  report  a  full  life 
cycle  cost  for  each  major  defense  acquisition  program  (MDAP) 

DoDI  5000.2:  7he  CAIG  shall  prepare  an  independent  life- 
cycle  cost  estimate  and  report  for  all  milestone  reviews  after 
Milestone  A  (Program  Initiation/Milestone  B  &  C). 

WHEN 

Many  entry  point  in  PPBES,  Acquisition  Milestone  Process 
and  JCIDS 

WHO 

Well  defined  functional  community,  with  professionally 
grounded  methodologies  and  guidance 
oOSD  CAIG 
oService  Cost  Centers 

HOW 

Well  defined  and  professionally  grounded  processes, 
methodologies  and  guidance. 

Who  Does  Cost  Estimating  and  Cost  Analysis  in  the  DoD? 


Secretary  of  Defense 


OSD  (C) 

F^AE-Resource  Analysis 

Rick  Burke 

Secretary 

Army 

Secretary 

Air  Force 

Secretary 

Navy 

ASA 

(FM) 

ASAF 

(FM) 

ASN 

(FM) 

DASA-Cost  & 
Economic 
Analysis 

Steve  Bag  by 

Air  Force  Center 
for  Cost  Analysis 

Rich  Hartley 

Naval  Cost 
Analysis  Division 

Wendv  Kune 

A 

▲ 

A 

COST  ANALYST  ENVIRONMENT 


ACCOUNTANT 

•  Financial  Analysis 

•  Cost  Data  Analysis 

•  Proposal  Analysis 

•  Overhead  Analysis 


STATISTICIAN 

ENGINEER 

•  Prod.  Process 

•  Regression  Analysis 

•  Aero  Design 

•  Forecasting 

•  Scheduling 

•  Sensitivity  Testing 

•  Materials 

•  Learning  Curve  Applications 

•  Performance  Parameters 

•  Analysis  of  Commercial  Models 

•  System  Integration 

•  Production  Engineering 

•  Test  Program  Development 

i  L 

COMPUTER  SCIENTIST/ 
MATHEMATICIAN 

•  Model  Development 

•  CER  Development 

•  Programming 

•  Analysis  of  Proposals 

•  Analysis  of  Commercial  Model 


ECONOMIST 

Inflation- vs-F  oreign 
Exchange  Rates 
Labor  Agreements 
Break  Even  Analysis 
Present  Value  Analysis 


— 

BUDGETING 

•  Program  Specific 

•  Internal  Company  (Industry) 

•  Defense  Budget  Appropriations 


— 

SALESPERSON 

•  Sell  Estimate 

•  Sell  Approach 

•  Sell  Self  as  Knowledgeable 


PUBLIC  AFFAIRS 

•  Appropriation  Process 

•  Congressional  Process//Motivations 
•GAO 

•  General  Public 

•  Press 


When  is 


Budget  development, 
justification,  execution 


naiysW^rid  Estimating 


Capability 

Managers 


disquisition 


Program  development  and 
justification 

Balance  of  Investment 
studies  ( force  mix; 
investment  portfolio; 
business  portfolio,  etc.) 

Selection  of  equipment 
through  AoAs 

Efficient  management 
through  equipment  life  cycle 


Operational 

^Planners 


Supply  chain 
managers 


Capability 

Supporters 
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•All  phases  of  life  cycle. 
•All  processes 


Types  of  Cost  Estimates 


o  Life  Cycle  Cost  Estimate  (LCCE):  Cradle  to  grave  estimate 
includes  R&D,  production,  operations/  support,  and  disposal. 

o  Independent  Cost  Estimate  (ICE):  LCCE  of  most  likely  cost 
developed  by  an  independent  organization 

o  Budget  Estimate:  For  inclusion  in  budget  to  support  current 
activities 


o  Rough-Order-of-Magnitude  (ROM):  Pre  design  effort,  with  very 
little  specific  information  about  the  project . 

o  Analysis  of  Alternatives  (AoA)  :  Evaluates  costs,  benefits, 
advantages  and  disadvantages  of  different  alternatives 

o  Activity  Based  Costing  (ABC):  Accounting  methodology  that 
assigns  resources  and  overhead  costs  all  costs  to  activities, 
products  and  services  to  support  making  decisions  about  pricing, 
outsourcing,  capital  expenditures  and  operational  efficiency. 


Know  the  Purpose  of  the  Analysis  before  You 

Start  It. 


NAVAL 
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Explosion  in  Requirements  to 
do  Cost  Estimating 


GOVERNMENT 

COMMERCIAL  AND 
EDUCATION 

4  DoD — by  statute,  every  major 

4  FAR  drives  requirements 

program  requires  an  independent  cost 

for  Cost  Estimating  System 

estimate  (ICE) 

4  Competitive  Environment 

-1-  Intelligence  Community--  by 

forces  need  to  understand  and 

statute,  every  major  program  requires 

control  costs 

an  ICE 

4-  Mergers  and  Acquisitions 

=J-  NASA-  ISSPO  overruns,  failed 

force  focus  on  enterprise-wide 

missions,  Challenger  tragedy,  ESMD 

consistency  issues 
| 

(Mission  to  Mars  challenge),  etc. 

-1-  Cost  of  Higher  Education 

-1-  FAA-  Next  generation  Air  T raffic 
Control  System;  Need  to 
professionalize  cost  estimating 
community. 

(Cost  vs.  Price) 

•  •!-• 
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If  there’s  an  ICE,  there’s  going  to  be  a  PM’s  LCCE 
and  a  contractor’s  CE  and  a  subcontractor’s  CE,  and 
so  on... 


❖Current  Status:. 


❖T  rends 


❖  The  Future  Estimation  of  the  skillsets  that 
wiTl  be  needed  by  the  next  generation  of  cost 
estimators,  and  where  they  are  likely  to  gain 
these  skillsets. 


^Estimation  of  the  skillsets 
that  will  be  needed  by  the 
next  generationof  cost 
estimators,  and  where  they 
are  likely  to  gain  these 
skillsets. 


Very  few  of  us  studied 

cost  estimating  or  analysis  in 

school 
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Available  Training  and 
Education  Opportunities 


SCHOOLHOUSE 

COLLEGE  AND 
UNIVERSITY 

PROFESSIONAL 

ORGANIZATIONS 

AFIT 

UCLA 

SCEA 

DAU  (DAWIA) 

Univ. 

Maryland 

AACE 

ALMC 

George 

Mason  Univ. 

ISPA 

NPS 

Rutgers? 

Cal  Tech? 

,  NAVAL 
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MainlyTor 
government 
person 


C3 


Available  to  all 


51 


Society  of  Cost  Estimating  and  Analysis 

(SCEA) 

www.sceaonline.net 


A  Non-Profit  Organization  dedicated  to  improving 
cost  estimating  and  analysis  in  government  and 
industry  and  enhancing  the  professional 
competence  and  achievements  of  its  members. 


Benefits  to  be  Gained  From  Belonging 
•  •  to  the  Cost  Estimating  Professional 
Community 

o  Uniform  understanding,  across  the  Boeing  enterprise,  of 
fundamental  practices,  techniques,  standards  of 
professional  cost  estimating  community. 

o  Understand  and  apply  accepted  models,  processes  and 
techniques,  thereby  achieving  consistency,  credibility, 
transparency,  and  reproducibility. 

o  Gain  access  to  research  and  new  professional  practices, 
thereby  enhancing  the  professionalism  of  your  products. 

o  Enhanced  standards  of  personal  ethics  and  practice  for 
those  within  the  profession. 
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Selected  Goals  of  the  Society 


o  Promote  a  common 
Body  of  Knowledge  as  a 
standard  for  individual 
excellence 

o  Foster,  promote,  and 
conduct  research  and 
educational  programs 

o  Develop  and  maintain 
standards  of  proficiency 
and  performance 
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•  •  •  Publications 


o  National  Estimator 

•  2-3  Times  per  year 
Practical  applications 
Lessons  Learned 


o  Journal  of  Cost 
Analysis 

Refereed  Journal 
•  Academic  Flavor 
Changed  name 
New  Editors 
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Certification  Program 


Certified  Cost  Estimator/Analyst  (CCE/A) 

Provides  professional  recognition  to  those  applicants 
possessing  the  requisite  education  and/or  job 
experience  and  successfully  demonstrating  their 
knowledge 
and  skills  through  a 
written  examination 

■  Valid  for  5  years: 
re-certification  based 
on  earned  points  or 
by  examination 


Educational  Opportunities 


o  National  Conferences: 

Training,  presentations,  panel  discussions 

o  Regional  Conferences/Symposia: 

Specific  topics  of  interest 

o  Local  Chapter  Programs: 

Education  and  training,  speakers  of  interest 

o  Training  Modules/Certification  Courses 

Developing  new  approach 
Offer  to  Chapters/Regions 


Cost  Programmed  Review 
of  Fundamentals 


Mission  Statement  16  Training  Modules 


•  To  provide  world-class  cost 
estimating  training  materials 
that  will 

•help  define  the  body  of 
knowledge  for  cost  estimating 
and  analysis;  and 
•prepare  SCEA  members 
thoroughly  for  the  CCE/A 
exam. 

•  What  else  was  in  it  for  SCEA? 

o  Chance  to  shape  the 
profession 
Opportunity  to  make 
SCEA  the  provider  of 
choice  for  cost  estimating 
and  analysis  training. 
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•  Cost  Estimating 

1:  Cost  Estimating  Basics 
2:  Costing  Techniques 
3:  Parametric  Estimating 

•  Cost  Analysis  Techniques 

4:  Data  Collection/Normalization 
5:  Index  Numbers/Inflation 

•  Analytical  Methods 

6:  Basic  Data  Analysis  Principles 
7:  Learning  Curve 
8:  Regression  Analysis 
9:  Cost  Risk  Analysis 
10:  Probability  and  Statistics 

•  Specialized  Costing 

11:  Manufacturing  Cost  Estimating 
12:  Software  Cost  Estimating 

•  Management  Applications 

13:  Economic  Analysis 
14:  Contract  Pricing 

15:  Earned  Value  Management  Systems 
(EVMS) 

16:  Cost  Management 


oBACKUP  SLIDES 


Cost  Estimating  Process 


O 


Work  Breakdown  Structure  (WBS) 
Development 


o  Program/System  Baseline 
Development 

o  Data  Collection  and  Analysis 


o  Cost  Element  Methodology 


I  Lo  Estimate  Development  and 
Validation 

V  o  Results  and  Report  Generation 
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Cost  Estimating-  What? 


o  Cost  Estimating: 

The  process  of  collecting  and  analyzing  historical  data  and 
applying  quantitative  models,  techniques,  tools,  and 
databases  to  predict  the  future  cost  of  an  item,  product, 
program  or  task. 

The  art  of  approximating  the  probable  worth  (or  cost)  of 
something  based  on  information  available  at  the  time. 

The  act  of  developing,  analyzing,  and  documenting  cost 
estimates  using  analytical  approaches  and  techniques 


o  Purpose  of  cost  estimating 

Translate  system/functional  requirements  associated  with 
programs,  projects,  or  processes  into  budget  requirements 

Determine  and  communicate  a  realistic  view  of  the  likely  cost 
outcome,  which  can  form  the  basis  of  the  plan  for  executing 
the  work 
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How) is  Cost  Estimating  Done? 

Three  essential  Costing  Techniques 

Analogy:  “It’s  like  one  of  these”  subjectively  compares  the 
new  system  with  one  or  more  existing  similar  systems  for 
which  there  is  accurate  cost  and  technical  data. 

Parametric:  “This  pattern  holds”  sometimes  known  as  the 
statistical  method,  this  technique  generates  an  estimate 
based  on  system  performance  or  design  characteristics.  It 
uses  a  database  of  elements  from  similar  systems.  It  differs 
from  analogy  in  that  it  uses  multiple  systems  and  makes 
statistical  inferences  about  the  cost  estimating  relationships. 

•  Build-Up:  “It’s  made  up  of  these”  “bottom-up”  method  of 
cost  analysis  that  is  the  most  detailed  of  all  the  techniques 
and  the  most  costly  to  implement.  Each  WBS  element  must 
be  costed  to  build  the  cost  estimate  for  the  entire  program. 

Expert  Opinion:  “The  other  methods  are  not  available” 

•:  Costing  Techniques  rely  on  statistical  properties,  logical 
relationships,  emotional  appeal. 

❖They  are  based  on  historical  data 

❖Techniques  are  generally  aligned  with  life  cycle  phases 


Where  statistical  cost  estimating  methods  are 

currently  used 


❖  Industry  and  finance 

•  Quality  control 

-  Investment  analysis 

•  Monitoring  of  sales 

-  Portfolio  Theory 

•  Economic  forecasting 

-  Accounting 

•  HR  monitoring 

-  Auditing 

❖  Engineering 

•  Fault  and  failure  monitoring 

•  Process  evaluation 

•  Yield  optimization 
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The  statistical  method  is  more  than  an  array  of 
techniques.  The  statistical  method  is  a  Mode  of 
Thought;  it  is  Sharpened  Thinking;  it  is  Power.  ” 
(WE  Deming,  1953) 
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